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Abstract In this paper, we show that if a lower-order Hankel tensor is positive semi- 
definite (or positive definite, or negative semi-definite, or negative definite, or SOS), 
then its associated higher-order Hankel tensor with the same generating vector, where 
the higher order is a multiple of the lower order, is also positive semi-definite (or pos¬ 
itive definite, or negative semi-definite, or negative definite, or SOS, respectively). 
Furthermore, in this case, the extremal H-eigenvalues of the higher order tensor 
are bounded by the extremal H-eigenvalues of the lower order tensor, multiplied 
with some constants. Based on this inheritance property, we give a concrete sum- 
of-squares decomposition for each strong Hankel tensor. Then we prove the second 
inheritance property of Hankel tensors, i.e., a Hankel tensor has no negative (or non¬ 
positive, or positive, or nonnegative) H-eigenvalues if the associated Hankel matrix 
of that Hankel tensor has no negative (or non-positive, or positive, or nonnegative, 
respectively) eigenvalues. In this case, the extremal H-eigenvalues of the Hankel ten¬ 
sor are also bounded by the extremal eigenvalues of the associated Hankel matrix, 
multiplied with some constants. The third inheritance property of Hankel tensors is 
raised as a conjecture. 
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1 Introduction 

Hankel structures are widely employed in data analysis and signal processing. Not 
only Hankel matrices but also higher-order Hankel tensors arise frequently in many 
disciplines such as exponential data fitting 15151121151 . frequency domain subspace 
identification fTTl . multidimensional seismic trace interpolation MT9l . and so on. Fur¬ 
thermore, the positive semi-definite Hankel matrices are most related with the mo¬ 
ment problems, and one can refer to jniTifm In moment problems, some necessary 
or sufficient conditions for the existence of a desired measure are given as the positive 
semi-definiteness of a series of certain Hankel matrices. 

An m [h -order Hankel tensor Jf’ £ C " 1 x " 2x -x% j s a multidimensional array whose 
entries obey a function of the sums of indices, i.e., 

T ‘^i\^ i ]■ i; him ' ik 0,1,... ,Hk 1, k 1,2, ... , m. 

where the vector h is called the generating vector of this Hankel tensor dif ll6ll9lfT5l 
ED- Actually, the generating vector and the size parameters totally determine this 
Hankel tensor. The multiplication of a tensor & and a matrix M on the k lh mode (see 
[|8] Chapter 12.4]) is defined by 

n— 1 

x kM)i 1 ...i k _ l j k i k+l ...i m := Y 
h =0 

When the matrix degrades into a vector, Qi lfl4l introduced some simple but useful 
notations 

:= & x i x x 2 x • • • x m x, 

^x"^ 1 := ST X2X---x m x. 

Each m th -order n-dimensional square tensor can induce a degree-m multivariate poly¬ 
nomial of n variables 

n — 1 

P3r(x) ■■= & x” 1 = Y. &hh~im X h X h ■ ■ • X >m■ 

i'l,...,i m =0 

Suppose that m is even. If p^(x) is always nonnegative (or positive, or non-positive, 
or negative) for all nonzero real vectors x, then the tensor is called a positive 
semi-definite tensor (or positive definite tensor, or negative semi-definite tensor, or 
negative definite tensor, respectively) (see El). If p (x) can be represented as a 
sum of squares, then we call the tensor an SOS tensor (see ED). Apparently, 
an SOS tensor must be positive semi-definite, but the converse is generally not true. 
If we restrict on Hankel tensors, then it is still an open question whether a positive 
semi-definite Hankel tensor is also SOS. 
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Qi flip showed an inheritance property of Hankel tensors. The generating vector 
of a Hankel tensor also generates a Hankel matrix, which is called the associated 
Hankel matrix of that Hankel tensor tm It was shown in lfl5l that if the Hankel 
tensor is of even order and its associated Hankel matrix is positive semi-definite, then 
the Hankel tensor is also positive semi-definite. In IIP , a Hankel tensor is called a 
strong Hankel tensor if its associated Hankel matrix is positive semi-definite. Thus, 
the above result is that an even order strong Hankel tensor is positive semi-definite. 
In this paper, we explore more inheritance properties of Hankel tensors. 

The first inheritance property of Hankel tensors we will establish in this paper is 
that if a lower-order Hankel tensor is positive semi-definite (or positive definite, or 
negative semi-definite, or negative definite, or SOS), then its associated higher-order 
Hankel tensor with the same generating vector, where the higher order is a multi¬ 
ple of the lower order, is also positive semi-definite (or positive definite, or negative 
semi-definite, or negative definite, or SOS, respectively). The inheritance property 
established in lfT31l can be regarded as a special case of this inheritance property. Fur¬ 
thermore, in this case, we show that the extremal H-eigenvalues of the higher order 
tensor are bounded by the extremal H-eigenvalues of the lower order tensor, multi¬ 
plied with some constants. 

In 0, it was proved that strong Hankel tensors are SOS tensors, but no concrete 
SOS decomposition was given there. In this paper, by using the inheritance property 
described above, we give a concrete sum-of-squares decomposition for each strong 
Hankel tensor. 

The second inheritance property of Hankel tensors we will establish in this paper 
is an extension of the inheritance property established in 1T31 to the odd-order case. 
In the common sense, positive semi-definiteness and SOS property are only well- 
defined for even order tensors. By fl4l . an even order symmetric tensor is positive 
semi-definite if and only if it has no negative H-eigenvalues. In this paper, we will 
show that if the associated Hankel matrix of a Hankel tensor has no negative (or non¬ 
positive, or positive, or nonnegative) eigenvalues, then the Hankel tensor has also no 
negative (or non-positive, or positive, or nonnegative, respectively) H-eigenvalues. 
In this case, we show that the extremal H-eigenvalues of the Hankel tensor are also 
bounded by the extremal eigenvalues of the associated Hankel matrix, multiplied with 
some constants. 

Finally, we raise the third inheritance property of Hankel tensors as a conjecture. 

This paper is organized as follows. In Section 2, we first introduce some basic 
concepts and properties of Hankel tensors. Then by using a convolution formula, 
we show that if a lower-order Hankel tensor is positive semi-definite (or positive 
definite, or negative semi-definite, or negative definite, or SOS), then its associated 
higher-order Hankel tensor with the same generating vector and a multiple order, is 
also positive semi-definite (or positive definite, or negative semi-definite, or negative 
definite, or SOS, respectively). In this case, some inequalities to bound the extremal 
H-eigenvalues of the higher order tensor by the extremal H-eigenvalues of the lower 
order tensor, multiplied with some constants, are given. Based on this inheritance 
property, we give a concrete sum-of-squares decomposition for each strong Hankel 
tensor. In Section 3, we investigate some structure-preserving Vandermonde decom¬ 
positions of some particular Hankel tensors, and we prove that each strong Hankel 
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tensor admits an augmented Vandermonde decomposition with all positive coeffi¬ 
cients. With this tool, we show that if the associated Hankel matrix of a Hankel ten¬ 
sor has no negative (or non-positive, or positive, or nonnegative) eigenvalues, then 
the Hankel tensor has also no negative (or non-positive, or positive, or nonnegative, 
respectively) H-eigenvalues, i.e., the second inheritance property of Hankel tensors 
holds. In this case, we show that the extremal H-eigenvalues of the Hankel tensor 
are also bounded by the extremal eigenvalues of the associated Hankel matrix, mul¬ 
tiplied with some constants. Numerical examples are given in Section 4. The third 
inheritance property of Hankel tensors is raised in Section 5 as a conjecture. 


2 The First Inheritance Property of Hankel Tensors 

This section is devoted to the first inheritance property of Hankel tensors. We will 
prove that if a lower-order Hankel tensor is positive semi-definite or SOS, then a 
Hankel tensor with the same generating vector but a high multiple order is also posi¬ 
tive semi-definite or SOS, respectively. 


2.1 Hankel Tensor-Vector Products 

We shall have a close look at the nature of the Hankel structure first. Ding et al. 
© proposed a fast scheme for multiplying a Hankel tensor by vectors. The main 
approach is embedding a Hankel tensor into a larger anti-circulant tensor, which can 
be diagonalized by the Fourier matrices. A special /» lh -order V-dimensional Hankel 
tensor r £ is called an anti-circulant tensor, if its generating vector has a period V. Let 
the first V components of its generating vector be c = [co,ci,... ,c/v-i] T - Then the 
generating vector of has the form 

[co,ci,..., cn ~ i,... ,co,ci,...,cat- 1 ,co,ci,...,cv-m] T £ 

Thus we often call the vector c the compressed generating vector of the anti-circulant 
tensor . Ding et al. proved in © Theorem 3.1] that an »i th -order V-dimensional 
anti-circulant tensor can be diagonalized by the V-by-V Fourier matrix, i.e., 

‘if = x \ /A x 2 Fv• • • x,„Fv, 

where Fv = (exp(^p i^)Yjk=t) = V - 1) is the V-by-V Fourier matrix, and is a 
diagonal tensor with diagonal entries ifft(c) (Here, “ifft” is an abbreviation of 

“inverse fast Fourier transform”.) Then given m vectors yi,y 2 , ■ ■ ■ ,y m £ C ,v , we can 
calculate the anti-circulant tensor-vector product by 

^ x i yt x 2 y 2 • • • x m y m = (FyC) 7 (F n yi . * F N y 2 . *••••* F N y m ), 

where is a Matlab-type notation for multiplying two vectors component-by- 
component, and Fjvy* and F£c can be realized via fft and ifft, respectively. 

Let Jj? be an iH th -order Hankel tensor of size ni x n 2 x • • • x n m and h be its 
generating vector. Taking the vector h as the compressed generating vector, we can 
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also form an anti-circulant tensor of order m and dimension N = n\-\ -| -n m — 

m + 1. Interestingly, we find out that the Hankel tensor -W, 1 is exactly the first leading 
principal subtensor of that is, : «t, 1 : « 2 ,..., 1 : n m ). Hence, the 

Hankel tensor-vector product x i Xi X o xi ■ ■ ■ x x„, is equal to the anti-circulant 
tensor-vector product 

x i 

where 0 denotes an all-zero vector of proper size. Thus it can be computed via 


X 2 


Xixi x2x 2 * * * x m x m = (F^h) T F n 


■ *F n 


. * • • • . * F]y 


0 


Particularly, when Jff is square and all the vectors are the same, i.e., n := n\ = ■ ■ ■ = 
n m and x := xi = • • • = x m , the homogeneous polynomial can be evaluated via 


Jfx' n = (F* h) 1 F n 


( 2 . 1 ) 


where N = mn —m + 1, and v['"l = [v^v™,..., v^] T stands for the componentwise 
m th power of the vector v. Moreover, this scheme has an analytic interpretation. 


2.2 A Convolution Formula 


In matrix theory, the multiplications of most structured matrices, such as Toeplitz, 
Hankel, Vandermonde, Cauchy, etc., with vectors have their own analytic interpreta¬ 
tions. Olshevsky and Shokrollahi EU listed several important connections between 
fundamental analytic algorithms and structured matrix-vector multiplications. They 
claimed that there is a close relationship between Hankel matrices and discrete con¬ 
volutions. And we will see shortly that this is also true for Hankel tensors. 

We first introduce some basic facts about discrete convolutions. Let two vectors 
u £ C" 1 and v £ C" 2 . Then their convolution w = u * v £ C” 1+ " 2_1 is a longer vector 
defined by 

k 

Wk = ^ Uj\’k-j for k = 0,1,...,«i + «2 — 2, 
f=o 

where uj = 0 when j > n\ and vj = 0 when j > m. Denote p u (4) and /? v (4) as the 
polynomials whose coefficients are u and v, respectively, i.e., 

Pu(^) = U Q + U^-\ - \-u ni -i£ ni ~\ Pv(^) = v0 + 1'!^ H-Fv„ 2 _ 1 4" 2 ~ 1 , 

Then we can verify easily that u * v consists of the coefficients of the product p u (4) • 
/? v (4). Another important property of discrete convolutions is that 


V 


,*V 


u* y = V 


l 
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for an arbitrary (n\ + «2 — 1 )-by-(«i + m — 1) nonsingular Vandermonde matrix V. 
In applications, the Vandermonde matrix is often taken as the Fourier matrices, since 
we have fast algorithms for discrete Fourier transforms. 

Similarly, if there are more vectors ui,U 2 ,... ,u m , then their convolution is equal 


to 


Ui * U2 * • • • * U m = V 


V 


,*V 


,*V 


( 2 . 2 ) 


where V is a nonsingular Vandermonde matrix. Comparing (12.11) and (12.2b . we can 
write immediately that 


J{fx m = h 1 ( x *x * • • • *x ) =: h T x* m . 

m 


(2.3) 


Employing this convolution formula for Hankel tensor-vector products, we can derive 
the inheritability of positive semi-definiteness and SOS property of Hankel tensors 
from the lower-order case to the higher-order case. 


2.3 Lower-Order Implies Higher-Order 

Use M J m to denote an m th -order n -dimensional Hankel tensor with the generating 
vector h G 1 , where m is even and n = qk — q + 1 for some integers q and 

k. Then by the convolution formula (12.3b . we have J%„x! n = h T x*"' for an arbitrary 
vector x € C". Assume that is a (gw) th -order ^-dimensional Hankel tensor that 
shares the same generating vector h with Similarly, it holds that M > qm y qm = 
h T y* 9 '" for an arbitrary vector y G C k . 

If is positive semi-definite, then it is equivalent to say that J^ m x'" = h T x* m > 
0 for all x G K". Note that y* qm = Thus for an arbitrary vector y G R*, we 

have 

,^ qm y qm = h T y* qm = h T (y * q )* m = M J m (f q ) m > o. 

Therefore, the higher-order but lower-dimensional Hankel tensor is also positive 

semi-definite. Furthermore, if M’m is positive definite, i.e., M m x! n > 0 for all nonzero 
vector x G R", then M qm is also positive definite. We may also derive the negative 
definite and negative semi-definite case similarly. 

If is SOS, then there are some multivariate polynomials pi,p 2 ,...,p r such 
that for each x G R" 

Jf m x' n = h T x* m = pi (x) 2 + p 2 (x) 2 H-h prix) 2 . 

Thus we also have for each y G R /: 

^ \ m y qm = ftn(y*T = Pl (y* q ) 2 + P2 (y* q ) 2 + • • • + Pr (y* q ) 2 . (2.4) 

From the definition of discrete convolutions, we know that y* q is also a multivariate 
polynomial about y. Therefore, the higher-order Hankel tensor Jt?q m is also SOS. 
Moreover, the SOS rank, i.e., the minimum number of squares in the sum-of-squares 
representations (see 0), of Jrffqm is no larger than the SOS rank of J% n . Hence, we 
summarize the inheritability of positive semi-definiteness and SOS property in the 
following theorem. 
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Theorem 2.1 If an nf'-order Hankel tensor is positive (negative) (semi-)definite, 
then the (qm) l ' n -order Hankel tensor with the same generating vector is also positive 
(negative) (semi-)definite for an arbitrary positive integer q. If an m th -order Hankel 
tensor is SOS, then the (qm)^-order Hankel tensor with the same generating vector 
is also SOS with no larger SOS rank for an arbitrary positive integer q. 

Let S? be an m th -order n-dimensional tensor and x £ C" be a vector. Recall 
that is a vector with (^x'"* 1 ),- = £" 2 im=l <% 2 ...,„,x, 2 ...x, m . If there is a 

real scalar A and a nonzero real vector x £ R" such that ^Ax" !_1 = Axl” 1-1 !, where 
x [m-i] then we call A an H-eigenvalue of the tensor ST 

and x a corresponding H-eigenvector. This concept was first introduced by Qi OH, 
and H-eigenvalues are shown to be very essential for investigating a tensor. By lfl4l 
Theorem 5], we know that an even order symmetric tensor is positive (semi-)definite 
if and only if all its H-eigenvalues are positive (nonnegative). Applying the con¬ 
volution formula, we can further obtain a quantified result about the extremal H- 
eigenvalues of Hankel tensors. 


Theorem 2.2 Let -Wf and be two Hankel tensors with the same generating 
vector and of order m and qm, respectively, where m is even. Denote the minimal and 
the maximal H-eigenvalue of a tensor as A m i n (-) and A max (-), respectively. Then 


Am in (JPqm) > 


c i • Amm if is positive semi-definite, 
ci-Kiin(J%n), otherwise , 


and 

. , ^ . J ci • Amax(^m)j « negative semi-definite, 

Amax(^m) < j ^ otherwise , 

where c x = min yeR * ||y* 9 ||“/||y|||m and c 2 = max yeRt . ||y* 9 ||£/||y||fm are positive 
constants depending on m, n, and q. 


Proof Since Jtfn and .LL J qm are even order symmetric tensors, from fl4l Theorem 5] 
we have 

Amin (-AA/) — ttiin 11 11 ... A mm i-'/dq nt ) — min qm , 


where n = qk — q + 1. 

If Jffqm is positive semi-dehnite, i.e., Jif qm y qm > 0 for all y £ R 4 , then we denote 
ci =min ygR * ||y* 9 ||m/||y||gm, which is a constant depending only on m, n, and q. Then 
by the convolution formula proposed above, we have 


Aminl'^gm) ^ C 1 ‘ min 


^ m y* m 


y esl lly^ll;: 


= c 1 ■min 


^n(y* q r 


yeR* ||y* ? ||;: 


> ci•min 

xeR" 




— ‘ Amin 


If M’qm is not positive semi-definite, then we denote c 2 — max yeR ,t || y*i;;;/iiy|i!m. 
Let y be a vector in R k such that A min (,^ m ) = / \\y\\q 


Him < 0. Then 


Lmin\dr qm ) > C 2 ■ ||^ || — C 2 ■ 


> c 2 • min ■ 

xeM" 




— C2 * A mm (■ ) ■ 


l|y* ? llm 


lly* ? r 
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Thus we obtain a lower bound of the minimal H-eigenvalue of whenever this 
tensor is positive semi-definite or not. The proof of the upper bound of the maximal 
H-eigenvalue of is similar. □ 


2.4 SOS decomposition of Strong Hankel Tensors 

When the lower order m in Theorem [2T] equals 2, i.e., matrix case, the (2<y) th -ortler 
Hankel tensor sharing the same generating vector with this positive semi-definite 
Hankel matrix is called a strong Hankel tensor. We shall discuss strong Hankel ten¬ 
sors in detail in later sections. Now we focus on how to write out an SOS decom¬ 
position of a strong Hankel tensor following the formula (12.41) . Li et al. (9j showed 
that even order strong Hankel tensors are SOS tensors. However, their proof is not 
constructive, and no concrete SOS decomposition is given. 

For an arbitrary Hankel matrix H generated by h, we can compute its Takagi 
factorization efficiently by the algorithm proposed by Qiao et al. (4), where only the 
generating vector rather than the whole Hankel matrix is required to store. The Takagi 
factorization can be written into H = UDU J , where U = [ui,U 2 , •• • , u,-] is a column 
unitary matrix (U*U = /) and D = diag(c/| .do. ..., d r ) is a diagonal matrix. When the 
matrix is real, the Takagi factorization is exactly the singular value decomposition of 
the Hankel matrix H. Further when H is positive semi-definite, the diagonal matrix D 
is with all nonnegative diagonal entries. Thus the polynomial x T Hx can be expressed 
as a sum of squares p i (x) 2 + P 2( x ) 2 H-h p r (x) 2 , where 

p k (x)=d l k /2 ujx, k = 1 , 2 ,... ,r. 

Following the formula (12.4b . the 2^-degree polynomial J# 2 q y 2q can also be writ¬ 
ten into a sum of squares < 7 i(y ) 2 + < 72 (y) 2 H-(-qv(y) 2 , where 

<7i(y) =d l k /2 ujy* 9 , k = 1 , 2 ,... ,r. 

Recall that any homogenous polynomial is associated with a symmetric tensor. And 
an interesting observation is that the homogenous polynomial qi<(y) is associated with 

a <y th -order Hankel tensor generated by 14 . Thus we determine an SOS decom- 

1 IT. 

position of a strong Hankel tensor 3%2 q by r vectors dj u* (k = 1 ,2,..., r). And we 
summarize the above procedure into the following algorithm. 


Algorithm 1 An SOS decomposition of a strong Hankel tensor. 

Input: The generating vector h of a strong Hankel tensor; 

Output: An SOS decomposition q\ (y) 2 + qiiy) 1 H- \~ #r(y) 2 of this Hankel tensor; 

1: Compute the Takagi factorization of the Hankel matrix generated by h: H = UDU T ‘, 

2: q^r. = dqj 1 for k — 1,2,..., r; 

3: Then generates a g th -order Hankel tensor as the coefficient tensor of each term qk{-) in the SOS 
decomposition for k — 1,2,..., r; 
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3 The Second Inheritance Property of Hankel Tensors 

In this section, we prove the second inheritance property of Hankel tensors, i.e., if 
the associated Hankel matrix of a Hankel tensor has no negative (or non-positive, 
or positive, or nonnegative) eigenvalues, then that Hankel tensor has no negative (or 
non-positive, or positive, or nonnegative, respectively) H-eigenvalues. A basic tool to 
prove this is an augmented Vandermonde decomposition with positive coefficients. 


3.1 Strong Hankel Tensors 

Let JP be an m th -order n-dimensional Hankel tensor generated by the vector h G 
R"'"-'". Then the square Hankel matrix H also generated by the vector h is called 
the associated Hankel matrix of the Hankel tensor Jff. If the associated Hankel matrix 
of a Hankel tensor JP is positive semi-definite, then we call this Hankel tensor Jff a 
strong Hankel tensor (see JT31). When m is even, we immediately know that an even 
order strong Hankel tensor must be positive semi-definite by Theorem l2.ll which has 
been proved in ITT3I Theorem 3.1]. 

Qi Ifl5j also introduced the Vandermonde decomposition of a Hankel tensor 

jr=£a k v° k m , (3.1) 

k= 1 

where v* is in the Vandermonde form [l, ^ k ,^ k , ..., ^~ 1 ] T , v om := yovo---oy is a 

m 

rank-one tensor, and the outer product is defined by 

(vi O V 2 O ■ ■ ■ O \ m )nh...i m = (Vi )h (v 2 )i 2 • • • (y m )i m . 

The Vandermonde decomposition is equivalent to factorize the generating vector of 
Jf?, i.e., 


h 0 
hi 
h 2 

— 

1 1 • 

4i & ■ 

^2 ■ 

i 

• ^ 

• t 2 


'a{ 

«2 

1 

s»» 

• • ^ 
_1 


pmn—m pmn—m 

>1 S2 

^ mn—m 


a, 


Since the above Vandermonde matrix is nonsingular if and only if r = mn — m + 1 
and %r are mutually distinct, every Hankel tensor must have such a Van¬ 

dermonde decomposition with the number of items no larger than mn — m + 1. When 
the Hankel tensor is further positive semi-definite, we desire that all the coefficients 
a k s are positive, so that each item is a rank-one positive semi-definite Hankel tensor 
when m is even. Moreover, a real square Hankel tensor is called a complete Han¬ 
kel tensor , if the coefficients a k s in one of its Vandermonde decompositions are all 
positive (see El). 

Nevertheless, the set of all complete Hankel tensors is not “complete”. Li et al. 
showed in j9j Corollary 1] that the m th -order n-dimensional complete Hankel tensor 
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cone is not closed and its closure is the m th -order /(-dimensional strong Hankel tensor 
cone. An obvious counterexample is e° m , where e„ = [0,...,0, 1] T is the last unit 
vector. Since all the Vandermonde vectors begin with a 1 and Cfy’s being positive, the 
positive semi-definite Hankel tensor e° m must not be a complete Hankel tensor. 

Fortunately, ae° m is the only kind of rank-one non-complete Hankel tensors. We 
will shortly show that if we add it into the basis, then all the strong Hankel tensors 
can be decomposed into an augmented Vandermonde decomposition 


k=\ 

Note that [l,^,^ 2 ,... , —> e„ when B, —> °°. The cone of Hankel tensors 

with an augmented Vandermonde decomposition is actually the closure of the cone 
of complete Hankel tensors. When a Hankel tensor has such an augmented Van¬ 
dermonde decomposition, its associated Hankel matrix H also has a corresponding 
decomposition 

r— 1 

H =Yj a ^k~ + a r^-l) m /2+V 
k= 1 

where va = [l, B£, ..., 1 T and v° 2 is exactly vv T , and vice versa. There¬ 

fore, if a positive semi-definite Hankel tensor has an augmented Vandermonde de¬ 
composition with all positive coefficients, then it is also a strong Hankel tensor, that 
is, its associated Hankel matrix must be positive semi-definite. Furthermore, when we 
obtain an augmented Vandermonde decomposition of its associated Hankel matrix, 
we can induce an augmented Vandermonde decomposition of the original Hankel 
tensor straightforward. Hence, we begin with the positive semi-definite Hankel ma¬ 
trices. 


3.2 A General Vandermonde Decompostion 

We shall introduce the algorithm for a general Vandermonde decomposition of an 
arbitrary Hankel matrix proposed by Boley et al. J2] briefly in this subsection first, 
then restrict the decomposition into the real situation. Let’s begin with a nonsingular 
Hankel matrix H £ C rxr . After we solve the Yule-Walker equation |8] Chapter 4.7] 


ho hi h2 ■ 
111 /l2 ho ■ 

1 

-s: 


ao 

a i 

ai 


i 

^ i 

-si 

h r _ 2 /z r -i h r ■ 
hr- 1 h r h r+ 1 • 

■ h 2r ~3 

■ h 2r -2_ 


1 

Q 

_i 


hlr-2 

7 


we obtain an r term recurrence for k = r, r +1 ,..., 2r — 2, i.e.. 


hk — a r -\hk-i + a r -ihk~2 H— ■ +0o^it-r- 
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Denote C as the companion matrix ( 8 ] Chapter 7.4.6] corresponding to the polynomial 
p(X) = A'— a r -\X r ~ l -aoA°, i.e., 


Let the Jordan canonical form of C be C = V 1 JV T , where J = diag{./| .Jo .,... ,J S } 
and // is the k / x k / Jordan block corresponding to eigenvalue A/. Moreover, the non¬ 
singular matrix V has the form 

V = [v,/ T v, {J T ) 2 x, ..., (/ T ) r_1 v], 

where v = [e^ j, e J, ._e J s l } T is a vector partitioned conformably with J and i 

is the first k/-dimensional unit coordinate vector. This kind of V is often called a 
confluent Vandermonde matrix. When the multiplicities of all the eigenvalues of C 
equal one, the matrix V is exactly a Vandermonde matrix. 

Denote ho as the first column of H and w = V 1 h ( |. There exists a unique block 
diagonal matrix D = diag{/J| ./.L,... ./J v }, which is also partitioned conformably 
with J, satisfying 

Dx = w and DJ 1 =JD. 


Moreover, each block D\ is a k/-by-k/ upper anti-triangular Hankel matrix. If we 


partition w = [wi,W 2 , 
by 


, w. s ] conformably with J, then the / th block is determined 


D, 


(w/)l (w /) 2 ••• (w/)*,' 

(w /) 2 ••• (w i)k, 0 


(w i)k, 0 ••• 0 


Finally, we obtain a general Vandermonde decomposition of a full-rank Hankel ma¬ 
trix 


H = V t DV. 


Furthermore, if the leading rxr principal submatrix, i.e., H(l : r, 1 : r), of an n x n 
rank -r Hankel matrix H is nonsingular, then H admits the Vandermonde decompo¬ 
sition H = (y rX n) T D rxr Vrxn- which is induced by the decomposition of the leading 
rxr principal submatrix. 

Nevertheless, this generalized Vandermonde decomposition is not enough for dis¬ 
cussing the positive definiteness of a real Hankel matrix, since the factors V and D 
could be complex even though H is a real matrix. We shall modify this decomposition 
into a general real Vandermonde decomposition. Assume that two eigenvalues Ai and 
A 2 of C form a pair of conjugate complex numbers. Then the corresponding parts in 
D and V are also conjugate, respectively. That is. 


Dx 


V,' 

d 2 


V2 




Dx 


vr 

Dx 


Ft. 


[n T v 2 t ] • 
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Note that 


1 

a + bi 


U T +V T i 


a —b 


|u T l 

V/] • 

a — bi 


u T — v T ; 

= [u v]-2 

—b —a 


V T 


Denote the / h column of as u j+Vji and the / h entry of the first column of D\ is 
iij + bji, where i = y/—l and Uy . Vy, aj.bj are all real. Then 


[n T v 3 


D\ 


vr 

n > 2 


A 


= [Ul Vi ... u kl • 


Ai A 2 ■■■ A k j 
M ••• A kl O 

_A kl O ■■■ O 



Kl 


v7 


i 

c 

i_ 


where the 2-by-2 block Aj is 


Aj= 2 


a j -bj 

~bj ~aj. 


We do the same transformations to all the conjugate eigenvalue pairs, then we obtain 
a real decomposition of the real Hankel matrix H = V T DV. Here, each diagonal 
block of D corresponding to a real eigenvalue of C is an upper anti-triangular Hankel 
matrix, and each one corresponding to a pair of two conjugate eigenvalues is an upper 
anti-triangular block Hankel matrix with 2-by-2 blocks. 

We claim that if the Hankel matrix H is further positive semi-definite, then all the 
eigenvalues of C are real and of multiplicity one. This can be seen by recognizing 
that the following three cases of the diagonal blocks of D cannot be positive semi- 
definite: (1) an anti-upper triangular Hankel block whose size is larger than 1, (2) a 
2-by-2 block Aj = 2 'V _ b J , and (3) a block anti-upper triangular Hankel block 
with the blocks in case (2). Therefore, when a real rank-;- Hankel matrix H is positive 
semi-definite and its leading rxr principal submatrix is positive definite, the block 
diagonal matrix D in the generalized real Vandermonde decomposition must be diag¬ 
onal. Hence this Hankel matrix admits a Vandermonde decomposition with r terms 
and all positive coefficients 


H=Y j a k \ k \J, a k > 0, \ k = [l,^,...,^ n 1 ] T . 

k= 1 

This result for positive definite Hankel matrices is already known (see l20l Lemma 

0 . 2 . 1 ]). 
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3.3 The Second Inheritance Property of Hankel Tensors 

However, the associated Hankel matrix of a Hankel tensor is not necessarily with a 
full-rank leading principal submatrix. Thus we shall study whether a positive semi- 
definite Hankel matrix can always decomposed into the form 

/•— 1 

H : Y. a iA'iA'J + a r e„eJ, a k > 0. 

k=l 


We first need a lemma about the rank-one modifications on a positive semi-definite 
matrix. Denote the range and the kernel of a matrix A as Ran(A) and Ker(A), respec¬ 
tively. 

Lemma 3.1 Let A be a positive semi-definite matrix with rank(A) = r. Then there 
exists a unique a > 0 such that A — auu T is positive semi-definite with rank(A — 
auu T ) = r— 1, if and only if u is in the range of A. 

Proof The condition rank(A — auu T ) = rank(A) — 1 obviously indicates that u G 
Ran (A). Thus we only need to prove the “if" part of the statement. 

Let the nonzero eigenvalues of A be Ai, Ai, ■ • • ,A r and the corresponding eigen¬ 
vectors be xi ,X2,... ,x r , respectively. Since u G Ran(A), we can write u = li ] x | + 

Pi x 2 H-1- /i,-x,-. Note that rank(A — auu T ) = rank(A) — 1 also implies dimKer(A — 

auu T ) = dimKer(A) + 1, which is equivalent to that there exists a unique subspace 

span{p} such that Ap = au(u T p) ^ 0. Write p = rjiXj + 772 X 2 H-1- 77 r x r . Then 

there exists a unique linear combination and a unique scalar a satisfying the require¬ 
ment, i.e., 

7); = Pi/h (i= 1 , 2 ,...,r) and a = ( 717 /AH-P Pf/K )~ 1 • 

Then we need to verify the positive semi-definiteness of A — auu T . For an arbi¬ 
trary vector x = |ixi + ^ 2 X 2 3-1- <^rX r in the range of A, we have 

x t Ax = ^fA| -I-1-4 2 A r and u T x = p\^\ H-h p r B, r . 

Then, along with the expression of a , the Holder inequality indicates that x T Ax > 
a(u T x) 2 , i.e., the rank-(r — 1) matrix A — auu T is also positive semi-definite. □ 

The following theorem tells that the leading (r — 1) x (r — 1) principal submatrix 
of a rank- 7 - positive semi-definite Hankel matrix is always full-rank, even when the 
leading rxr principal submatrix is rank deficient. 

Theorem 3.1 Let H G R" x ” be a positive semi-definite Hankel matrix with rank(//) = 
r. If the last column H(:,n) is linearly dependent with the first n — 1 columns //(:, 1 : 
77 — I), then the leading rxr principal submatrix H{ 1 : r, 1 : r) is positive definite. If 
H(:,n) is linearly independent with H(:, 1 : n — 1 ), then the leading (r — 1 ) x (r— 1 ) 
principal submatrix H{ 1 : r — 1,1 : r — 1 ) is positive definite. 
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Proof We apply the mathematical induction on the size n. First, the statement is ap¬ 
parently true for 2x2 positive semi-definite Hankel matrices. Assume that the state¬ 
ment holds for (n — 1) x (n — 1) Hankel matrices, then we consider the n x n case. 

Case 1: When the last column H(:,n) is linearly dependent with the first n — 1 
columns //(:, 1 : n— 1), the submatrix H( 1 : n— 1,1 : n — 1) is also a rank-r positive 
semi-definite Hankel matrix. Then from the induction hypothesis, H( 1 : r, 1 : r) is 
full rank if H{ 1 : n — l,n — 1) is linearly dependent with H{ 1 : n — 1,1 : n — 2), and 
H(l : r — 1,1 : r— 1) is full rank otherwise. We shall show that the column H( 1 : 
n — l,n — 1) is always linearly dependent with H(l : n — 1,1 : n — 2). 

Otherwise, the leading (r— 1) x (r— 1) principal submatrix H{\ : r — 1,1 : r— 1) 
is positive definite, and the rank of H( 1 : n — 2, 1 : n — 1) is r — 1. Since the column 
H(:,n) is linear dependent with the previous (n— 1) columns, the rank of H( 1: n — 2,: 
) is also r — 1. Thus the rectangular Hankel matrix H( 1 : n — 2.:) has a Vandermonde 
decomposition 


1 



k= 1 



Since H(n — l,n — 1) = H(n —2,n), the square Hankel matrix H(1 :n — 1,1 : n — 1) 
has a corresponding decomposition 


1 



tin—2 

hk 


This contradicts with rank(//(l : n — 1,1 : n — 1)) = r. Therefore, //( l : n — l,n— 1) 
must be linearly dependent with H(l : n — 1,1 : w — 2). Hence, the leading principal 
submatrix H(1 : r. 1 : r) is positive definite. 

Case 2: When the last column H(:,n) is linearly independent with the first n — 1 
columns //(:, 1 : n — 1), it is equivalent to that e„ is in the range of H. Thus, from 
Lemma [3. 11 there exists a scalar a,- such that H — rz,e„e,| is rank-(7 — 1) and also 
positive semi-definite. Referring back to Case 1, we know that the leading principal 
submatrix H(1 : r — 1,1 : r — 1) is positive definite. □ 

Following the above theorem, when H(:,n) is linearly dependent with //(:, 1 : 
n— 1), the leading r x r principal submatrix H{\ : r, 1 : r) is positive definite. Thus H 
has a Vandermonde decomposition with all positive coefficients 


r 



k= 1 


When H(:,n) is linearly independent with //(:, 1: n— 1), the leading (r—l)x(r—1) 
principal submatrix H( 1 : r— 1,1 : r — 1) is positive definite. Thus H has an aug- 
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merited Vandermonde decomposition with all positive coefficients 

r~ 1 T 

H = Y, (XkVkVk + «re„ej, a k > (1 v* = [l, • 

*=i 

Combining the definition of strong Hankel tensors and the analysis at the end of 
Section 3.1, we arrive at the following theorem. 

Theorem 3.2 Let -W: 1 be an m 1 ^-order n-dimensional Hankel tensor and the rank of 
its associated Hankel matrix be r. Then it is a strong Hankel tensor if and only if it 
admits a Vandermonde decomposition with all positive coefficients 

jr=£cc k v° k 'f a k > 0, v*= [1,S*”- 1 ] 7 , (3.2) 

k= 1 

or an augmented Vandermonde decomposition with all positive coefficients 

+ a r< m , <*k >0, \ k = [1, , <5'] ' ■ (3.3) 

k=\ 

After we obtain the above theorem, the strong Hankel tensor cone is actually un¬ 
derstood thoroughly. The polynomials induced by strong Hankel tensors are not only 
positive semi-definite and sum-of-squares, as proved in fl5l Theorem 3.1] and ||9l 
Corollary 2], but also sum-of-;w th -powers indeed. The detailed algorithm for comput¬ 
ing an augmented Vandermonde decomposition of a strong Hankel tensor is displayed 
as follows. 


Algorithm 2 Augmented Vandermonde decomposition of a strong Hankel tensor. 
Input: The generating vector h of a strong Hankel tensor; 

Output: Coefficients a*; Poles 

1: Compute the Takagi factorization of the Hankel matrix H generated by h: H — UDU J ; 

2: Recognize the rank r of H and whether e n is in the range of U ; 

3: If e„ ^ Ran (U), then 
4: If r < n, then 

5: a = 1/(1: r, 1 :r)^ T D(l : r, 1 :r) _1 t/( 1 : r, 1 ; r) _1 h(r: 2r-1); 

6: Elself r = n, then 

7: a = f/(l : r, 1 : r) _T D(l : r, 1 : r) _1 £/(l : r, 1 : r) -1 [h(r: 2r — 2) T ,y] T , where y is arbitrary; 

8: Endlf 

9: Compute the roots ,£ 2 ,..., % r of the polynomial p(£) = ^ r 1 1 -ao£°; 

10: Solve the Vandermonde system vander(|i,^ 2 ,• ■ .,(>)■ [ a l i a 2 . ■■■ ,<*;-] 1 = h(0 : r— 1); 

11: Else 

12: S, r = Inf; 

13: a r = (Y,' j=l U(nJ) 2 /DUJ)y K , 

14: Apply Algorithm [2] for the strong Hankel tensor generated by [ho,... — a,-] to 

compute a k and f for k= 1,2,... ,r— 1; 

15: Endlf 

16: return a k , S, k for k = 1,2,..., r; 


Employing the augmented Vandermonde decomposition, we can prove the fol¬ 
lowing theorem. 
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Theorem 3.3 If a Hankel matrix has no negative (or non-positive, or positive, or 
nonnegative) eigenvalues, then all of its associated higher-order Hankel tensors have 
no negative (or non-positive, or positive, or nonnegative, respectively) H-eigenvalues. 

Proof This statement for even order case is a direct corollary of Theorem 12. II 

Suppose that the Hankel matrix has no negative eigenvalues. When the order m is 
odd, decompose an //; lh -order strong Hankel tensor .ffl into - '/P = Yf k _ \ f4v? m + a,-e°'” 
with «/■ >{) (k = 1,2,..., r). Then for an arbitrary vector x, the first entry of 1 

is 

= £ 0v*)j ■ a k {\Jx) m ~ l = £ Uk{yjx) m ~ l > 0. 

k=l k= 1 

If Jif has no H-eigenvalues, then it is done. Assume it has at least one H-eigenvalue. 
Let A be an H-eigenvalue of Jf? and x be a corresponding H-eigenvector. Then when 
x\ f 0, from the definition we have 


A = (^x m - 1 ) 1 /x'[ ! - 1 >0, 

since m is an odd number. When xi = 0, we know that (.xA'x'" 1 ) | must also be zero, 
thus all the item a^vjx)" 1-1 = 0 for k = 1,2, ...,r— 1. So the tensor-vector product 


JTx m 1 = 2 W • a k(jJ x )' n 1 + e„ • a r xf 1 = e„ • a,xf 1 , 
k= 1 

and it is apparent that x = e„ and A = a,x"' 1 , where the H-eigenvalue A is also 
nonnegative. The other cases can be proved similarly. □ 

When the Hankel matrix has no negative eigenvalue, it is positive semi-definite, 
i.e., the associated Hankel tensors are strong Hankel tensors, which may be of either 
even or odd order. Thus, we have the following corollary. 

Corollary 3.1 Strong Hankel tensors have no negative H-eigenvalues. 

We also have a quantified version of the second inheritance property. 

Theorem 3.4 Let J4? be an -order n-dimensional Hankel tensor, and H be its 
associated Hankel matrix. IfH is positive semi-definite, then 


where c is a positive constant depending on m and n, c = minyggn ||y*? ||i/||y||m ifm 

is even, and c = min ye Rn Hy*^ - H^/llyllm—i {f m °dd- IfH is negative semi-definite, 
then 


A ma x(^)>C-A max (tf). 
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Proof When the minimal eigenvalue of H equals 0, the above equality holds for every 
nonnegative c. Moreover, when the order m is even. Theorem 12.21 gives the constant 
c. Thus, we need only to discuss the situation that H is positive definite and m is odd. 

Since H is positive definite, the Hankel tensor has a standard Vandermonde 
decomposition with positive coefficients 

jr=ia k v° k m , a k > 0, v*= [1,§£- 1 ] t , 

k= 1 

where ^ k ’s are mutually distinct. Then by proof of the above theorem, for an arbitrary 
nonzero vector x G M" 


= £ a k (vjx) m -' > 0, 

k= 1 

since [vi,V 2 ,... ,v r ] spans the whole space. So if A and x be an H-eigenvalue and a 
corresponding H-eigenvector of Jtf, then A must be positive and the first entry jri of 
x must be nonzero. 

Let h G be the generating vector of both the Hankel matrix H and 

the Hankel tensor 3^. Denote hj = h(l : (m — 1)(« — 1) + l), which generates a 
Hankel matrix I f and an (m — 1 ) st -order Hankel tensor . Note that H\ is a leading 
principal submatrix of H and .2A} is exactly the first row tensor of 3^, i.e., .2A'( 1.: 
Then we have 

(Jfx" 1 - 1 )! Jfix" 1 - 1 ^ Mix" 1 -' 

- -^ r 1 “ ~ mz-\' 

Now m — 1 is an even number, then we know from Theorem l2.2l that there is a constant 
c such that A mm ) > c ■ A m i n (H |). Therefore, we finally obtain that for each H- 
eigenvalue A of 3 ^', if exists, 


A > > C- Amin (Aft) > C-X^ n {H). 


The last inequality holds because H\ is a principal submatrix of H (see (8] Theorem 
8.1.7]). □ 

It is not clear whether we have a similar quantified form of the extremal H- 
eigenvalues of a Hankel tensor when its associated Hankel matrix has both positive 
and negative eigenvalues. 


4 Numerical Examples 

We shall employ some numerical examples to illustrate the proposed algorithms and 
theory. 
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Example 4.1 The first simple example is a 4 th -order 3-dimensional Hankel tensor 
generated by [1,0,1,0,1,0,1,0,1] T e R 9 . The Takagi factorization of the Hankel 
matrix generated by the same vector is 


'10 10 1' 


tsib 0 

_ 1 

0 10 10 


10 10 1 

= 

0 

0 10 10 


0 -4- 

10 10 1 


1 ^ 

— 0 



U J 


'3 o' 


■ O 

■ O 

u- 

0 2 


1 

0 

bl- 

0 

0 

1 _ 


Thus by AlgorithmQ] an SOS decomposition of M'y A is obtained, that is, 


^ [}’l J 2 >’3] ' 


1 0 1 
0 1 0 
1 0 1 



[y 1 y2 y 3 ] ■ 


0 1 0 
1 0 1 
0 1 0 


= (yf +yi+yi +2yiy 3 ) 2 + ( 2 ym+ 2y 2 y 3 ) 2 . 


y 1 

yi 


2 


However, the SOS decomposition is not unique, as we have seen in the last section 
that Jf? y 4 can also be written into ^(>’ 1 + y 2 + y 3 ) 4 + j(yi — y 2 + y 3 ) 4 . 

An m th -order n -dimensional Hilbert tensor (see d) is defined by 

■ ■ ■ 4m) = t : t : : : ~“7> h , ■ • •, = 0, 1, ... ,n — 1 . 

l\+l2-\ -b«m+ 1 

Apparently, a Hilbert tensor is a special Hankel tensor with the generating vector 
[l, j, ..., mn J m+1 \ T - Moreover, its associated Hankel matrix is a Hilbert matrix, 
which is well-known to be positive definite (see, e.g.. Ml81 ). Thus a Hilbert tensor 
must be a strong Hankel tensor. 

Example 4.2 We take the 4 th -order 5-dimensional Hilbert tensor, which is generated 
by , as the second example. Applying Algorithm[2]and taking y= yg 

in the algorithm, we obtain a standard Vandermonde decomposition of 


^=E«,vf, v*= 

k= 1 


-n T 


where a^s and C/_.’s are displayed in the following table. 


k 

1 

2 

3 

4 

5 

6 

7 

8 

9 

4 

0.9841 

0.9180 

0.8067 

0.6621 

0.5000 

0.3379 

0.1933 

0.0820 

0.0159 

a k 

0.0406 

0.0903 

0.1303 

0.1562 

0.1651 

0.1562 

0.1303 

0.0903 

0.0406 


From the computational result, we can see that a Hilbert tensor is actually a nonneg¬ 
ative strong Hankel tensor with a nonnegative Vandermonde decomposition. 

Finally, we shall test some strong Hankel tensors without standard Vandermonde 
decompositions. 
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Example 4.3 Randomly generate two real scalars ^ 1 ,^ 2 - Then we construct a 4 th - 
order n-dimensional strong Hankel tensor by 


T 

o4 

' i ' 

o4 

' i ' 

o4 

'o' 

0 




& 


0 


+ 


+ 


+ 


0 


sr 2 


en—2 
<=2 


0 

_0 


Lsr'J 


en— 1 

L<=2 J 


1 


For instance, we set the size n = 10 and apply Algorithm [2] to obtain an augmented 
Vandermonde decomposition of M 1 . We repeat this experiment for 10000 times, and 
the average relative error between the computational solutions ^ 1,^2 and the exact 
solution q\ , ^2 is 4.7895 x 10 12 . That is, our algorithm recover the augmented Van¬ 
dermonde decomposition of accurately. 


5 The Third Inheritance Property of Hankel Tensors 

We have proved two inheritance properties of Hankel tensors in this paper. We now 
raise the third inheritance property of Hankel tensors as a conjecture. 

Conjecture If a lower-order Hankel tensor has no negative H-eigenvalues, then its 
associated higher-order Hankel tensor with the same generating vector, where the 
higher order is a multiple of the lower order, has also no negative H-eigenvalues. 

We see that the first inheritance property of Hankel tensors established in Section 
2 is only a special case of this inheritance property, i.e., the case that the lower-order 
Hankel tensor is of even-order. At this moment, we are not able to prove or to disprove 
this conjecture if the lower-order Hankel tensor is of odd-order. However, we may see 
that if this conjecture is true, then it is of significance. Assume that this conjecture is 
true. If the lower-order Hankel tensor is of odd-order while the higher-order Hankel 
tensor is of even-order, then we have a new way to identify some positive semi- 
definite Hankel tensors, and discover a link between odd-order symmetric tensors of 
no negative H-eigenvalues, and positive semi-definite symmetric tensors. 
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